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Hindsight  ft  Foresight : 

The  Effect  of  Outcome  Knowledge  on  Judgment  Under  Uncertainty 

Hindsight  and  foresight  differ  formally  in  the  information  available 
tc  the  observer.  The  hindsightful  judge  possesses  outcome  knowledge,  i.e., 
he  knows  hov  things  turned  out.  The  foresightful  judge  does  not.  Although 
foresight  usually  implies  looking  at  the  future,  in  the  absence  of  outcome 
knowledge,  past  and  “uture  events  can  be  equally  Inscrutable. 

The  studies  presented  here  ask  two  questions  about  the  Judgmental 
differences  between  hindsight  and  foresight:  (a)  how  does  receipt  of 

outcome  knowledge  affect  Judgment?  and  (b)  how  aware  are  people  of  the 
effects  which  outcome  knowledge  has  on  their  perceptions?  Answers  to  these 
questions  will  shed  light  on  how  people  do,  and  how  they  might  better, 
learn  from  history. 

It  should  come  as  no  surprise  that  historiographers  and  philosophers 
of  history  have  discussed  these  questions  in  considerable  detail.  The 
centrality  of  outcome  knowledge  in  determining  the  nature  of  historical 
judgment  may  be  seen  in  the  following  remarks  by  Hexter  (1961): 

What  is  really  different  (with  historical  judgment)  is  that  the 
historian  knows  what  is  going  to  happen  next  ....  The  historian 
who  resolutely  refused  to  use  the  insight  that  his  own  particular 
time  gave  him  would  not  be  superior  to  his  fellows.  He  would  be 
foolish,  betraying  a singular  failure  to  grasp  what  history  is."  (p.  10) 


It  is  evidently  outcome  knowledge  which  enables  historical  judges  to  "put 
events  into  perspective,"  and  confidently  second-guess  the  decisions  of 
their  predecessors. 
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What  appears  to  be  the  historians’  consensual  answer  to  the  question 
of  what  outcome  knowledge  does  to  judgment  is  succinctly  expressed  by 
Georges  Florovsky  (1968): 

The  tendency  toward  determinism  is  somehow  implied  in  the  method  of 
retrospection  itself.  In  retrospect,  we  seem  to  perceive  the  lopic 
of  the  events  which  unfold  themselves  in  a regular  or  linear  fashion 
according  to  a recognizable  pattern  with  an  alleged  inner  necessity. 

So  that  we  get  the  impression  that  it  really  could  not  have  happened 
otherwise."  (p.  369) 

If  there  is  a tendency  to  see  whatever  is  reported  to  have  happened 
as  having  been  relatively  inevitable,  an  apt  name  might  be  "creeping 
determinism"— iu  contrast  with  philosophical  determinism,  the  consciour 
belief  that  whatever  happens  has  to  happen.  These  two  types  of  determinism 
are  essentially  independent.  The  philosophical  determinist  may  believe 
that  a reported  event  was  inevitable,  since  whatever  happens  is,  by  definition, 
inevitable.  He  may,  however,  still  be  surprised  by  its  occurrence.  Indeed, 
he  may  well  set  for  himself  the  task  of  researching  the  situation  until  its 
inevitable  character  becomes  apparent.  The  creeping  determinist  may  well 
be  totally  unaware  of  the  raging  debate  over  historical  inevitability  and 
free  will.  He  perceives  reported  events  as  having  been  more  or  less  bound 
to  happen,  simply  as  a matter  of  course. 

Phenomena  resembling  creeping  determinism  have  been  noted  by  psychologist  s 
as  well  as  historians.  One  example  is  Tversky  and  Kahneman’s  (1971) 

"law  of  small  numbers,"  the  belief  that  data  which  were  observed  more  or 
less  had  to  be  observed.  A uecond  is  the  tendency  to  "rework"  or  "reconstruct" 
the  biographies  of  deviants  to  show  that  their  present  diagnoses  (labels) 
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are  inevitable  products  of  their  life  histories  (Lofland,  1969,  Rosenhan, 

1973;  Schur,  1971).  A third  is  the  defensive  attribution  of  responsibility 
for  accidents,  a process  in  which  people  carefully  scrutinize  the  data 
describing  accidents  in  order  to  uncover  or  impose  a pattern  which  will 
increase  their  perceived  predictability  and  avoidability  (Walster,  1966). 

All  of  this  evidence  for  creeping  determinism  is,  however,  either  indirect, 
imprecise,  unsystematic  (anecdotal),  or  confounded  by  motivational  and 
emotional  issues. 

The  validity  of  "creeping  determinism"  as  a description  of  the  effects 
of  outcome  knowledge  on  judgment  was  directly  tested  in  Experiment  1 
below.  Experiments  2 and  3 examined  subjects'  awareness  of  the  effects  of 
outcome  knowledge  on  Judgment. 

Experiment  1 

Method 

Design.  The  six  sub-experiments  described  below  are  identical  e cept 
for  the  stimuli  used.  In  each,  subjects  were  randomly  assigned  to  one 
of  five  experimental  groups,  one  Before  group  and  four  After  groups.  In 
each  sub-experiment,  the  Before  group  read  a brief  (150  word)  description  of 
an  historical  or  clinical  event  for  which  four  possible  outcomes  were 
provided.  The  After  groups  read  identical  passages  to  which  a final  sen- 
tence presenting  one  ->f  the  possible  outcomes  as  the  "true"  outcome  had 
been  added.  As  the  possible  outcomes  were  mutually  exclusive,  three  of  the 
four  After  groups  received  "true"  outcomes  which  actually  had  not  happened. 
Subjects  in  all  groups  were  asked  to  (a)  estimate  the  likelihood  of  occurrence 
of  each  of  the  four  possible  outcomes,  and  (b)  evaluate  the  relevance  of 
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each  datum  in  the  event  description.  In  two  of  the  sub-experiments  subjects 
were  also  asked  to  indicate  the  relative  extent  to  which  they  relied  upon 
the  passage  and  upon  outside  information. 

Instructions.  The  cover  sheet  of  each  questionnaire  read; 

In  this  questionnaire  we  are  interested  in  knowing  how  people  judge 
the  likelihood  of  possible  outcomes  of  social  events.  A passage 
describing  an  unfamiliar  historical  event  appears  below.  We  will 
ask  you  to  evaluate  the  probability  of  occurrence  of  each  of  the 
four  possible  outcomes  of  the  event  [including  that  which  actually 
happened— for  After  subjects],  in  the  light  of  the  information 
appearing  in  the  passage. 

A typical  passage  was: 

1)  For  some  years  after  the  arrival  of  Hastings  as  governorrgeneral 
of  India,  the  consolidation  of  British  power  involved  serious  war. 

2)  The  first  of  these  wars  took  place  on  the  northern  frontier  of 
Bengal  where  the  British  were  faced  by  the  plundering  raids  of  the 
Gurkas  of  Nepal.  3)  Attempts  had  been  made  to  stop  the  raids  by  an 
exchange  of  linds,  but  the  Gurkas  would  not  give  up  their  claims 

to  country  under  British  control,  4)  and  Hastings  decided  to  deal  with 
them  once  and  for  all.  5)  The  campaign  began  in  November,  1814. 

It  was  not  glorious.  6)  The  Gurkas  were  only  some  12,000  strong; 

7)  but  they  were  brave  fighters,  fighting  in  territory  well-suited  to 
their  raiding  tactics.  8)  The  older  British  commanders  were  used 
to  war  in  the  plains  where  the  enemy  ran  away  from  a resolute  attack. 

9)  In  the  mountains  of  Nepal  it  was  not  easy  even  to  find  the  enemy. 


Hindsight  / Foresight 

6 

10)  The  troops  and  transport  animals  suffered  from  the  extremes  o 
heat  and  cold,  11)  and  the  officers  learned  caution  only  after  sharp 
reverses.  12)  Major-General  Sir  D.  Octerlony  was  the  one  commander 
to  escape  from  these  minor  defeats. 

From  The  age  of  reform,  by  E.  L.  Woodward, 
Oxford  University  Press,  London,  1938, 
pp.  383-384. 

The  possible  outcomes  offered  were:  1)  British  victory,  2)  Gurka  victory, 

3)  military  stalemate  with  no  peace  settlement,  4)  military  s'.alemate  with  a 
peace  settlement.  For  After  subjects  the  appropriate  outcome  was  appei  ’ .d 
to  the  passage  in  the  form  of  ai  additional  sentence,  such  as,  "The  two 
sides  reached  a military  stalemate,  but  were  unable  to  come  to  a peace 
settlement." 

Following  the  passage,  subjects  were  asked,  "In  cfe  light  of  the  infor- 
mation appearing  in  the  passage,  what  was  the  probability  of  occurrence 
of  each  of  the  four  possible  outcomes  listed  below.  (The  probabilities 
should  sum  to  100%)."  On  the  following  page,  each  datum  appeared  on  a 
separate  line  followed  by  a seven-point  scale  upon  which  subjects  were 
asked  to  indicate  "how  relevant  or  important  each  datum  in  the  event  des- 
cription was  in  determining  the  event's  outcome."  The  numbers  in  the  passage 
above  indicate  the  division  into  "data."  They  did  not  appear  in  the 
passage  presented  to  subjects. 

Stimulus  selection.  Four  different  events  uere  used  to  achieve 
greater  generality  for  the  results  obtained.  They  dealt  with:  (A)  the 

British-Gurka  struggle  cited  above;  (B)  the  near-riot  in  Atlanta,  Georgia, 
in  July,  1967,  as  described  in  the  Kerner  Commission  Report  on  Civil  Disorders 


r 
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(National  Advisory  Commission,  1968);  (C)  and  (D)  clinical  cases  reported  by 
Albert  Ellis  (1967).  For  Events  (C)  and  (D),  the  word  "social"  in  the  in- 
structions was  replaced  by  "individual"  and  the  word  "historical"  was  deleted. 

Several  methodological  considerations  guided  the  event  selection 
process:  (a)  The  event  should  be  sufficiently  familiar  to  permit  intelligent 

responses,  and  sufficiently  unfamiliar  to  rule  out  the  possibility  of 
subjects  knowing  what  really  happened — especially  those  receiving  false 
outcome  reports.  (b)  Past  events  were  used  in  order  to  allow  provision  of 
"true"  outcomes  to  the  After  groups.  (c)  The  space  of  possible  outcomes 
had  to  be  readily  partitionable . For  Events  (B),  (C)  , and  (D),  the  set  of 
outcomes  was  constructed  so  as  to  be  mutually  exclusive  and  exhaustive. 

Although  this  is  not  the  case  for  Event  (A),  pretests  indicated  that  ';he 
four  outcomes  provided  constituted  an  effective  partition. 

Subjects.  Approximately  equal  numbers  of  subjects  participated  in 
each  group  in  each  sub-experiment.  Event  (A)  (Gurkas)  was  administered 
twice,  once  to  a group  of  100  English-speaking  students  recruited  individually 
at  the  Hebrew  University  campus  in  Jerusalem  and  once  to  a class  of  80 

\ 

Hebrew-speak:? ng  subjects  at  the  University  of  the  Negev  in  Beer  Sheba. 

Event  (B)  (Riot)  was  administered  to  two  separate  classes  at  the  Heorew 

1 

University,  one  containing  87  Hebrew-speaking  psychology  majors  with  at 
least  one  year's  study  of  statistics,  and  one  of  100  Hebrew-speaking  students 
with  no  knowledge  of  statistics.  Event  (C)  (Mrs.  Dewar)  wa3  administered 
to  the  80  University  of  the  Negev  students;  Event  (D)  (George)  to  the  100 
statistics-less  Hebrew  University  students. 
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Procedure . Questionnaires  for  the  various  experimental  groups  were 
distributed  randomly.  Subjects  devoted  20-30  minutes  to  the  completion 
of  each  questionnaire. 

Results 

Probability  estimates.  Table  1 presents  the  mean  probability  assigned 
to  each  outcome  by  subjects  in  each  experimental  group  for  each  sub- 
experiment. The  Before  groups  appear  in  the  top  (no  outcome  provided) 
ine  of  the  results  for  each  event.  The  creeping  determinism  hypothesis 

Insert  Table  1 about  here 

predicts  that  After  subjects  told  that  a particular  outcome  has  happened 
will  assign  it  a higher  probability  than  will  Before  subjects.  Four 
outcomes  reported  to  different  groups  in  each  of  six  sub-experiments  afford 
2A  opportunities  to  test  the  hypothesis.  The  critical  comparisons  are 
between  the  outlined  diagonal  cells  (those  indicating  the  mean  probability 
assigned  to  an  outcome  by  subjects  for  whom  that  outcome  was  provided  as 
what  had  really  happened)  and  the  Before  cell  in  the  top  row  above  them. 

In  each  of  the  24  cases,  reporting  an  outcome  increased  its  perceived 
likelihood  of  occurrence  (p  < .001;  sign  test).  TVenty-two  of  these 
differences  were  individually  significant  (p  < 025;  median  test).  The 

creeping  determinism  effect  has,  thus,  been  obtained  over  all  variations 
of  subject  population,  event  description,  outcome  reported  and  truth  of 
outcome  reported.  The  differences  between  mean  Before  and  After  probabilities 
for  reported  outcomes  ranged  from  3.6%  to  23.4%,  with  a mean  of  10.8%. 

Slightly  over  70%  of  After  subjects  assigned  the  reported  outcome  a higher 
probability  than  the  mean  assignment  by  the  corresponding  Before  subjects. 
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No  outcome  was  judged  inevitable  by  any  Before  subject,  whereas  a 
small  proportion  (2.1%)  of  After  subjects  did  assign  100%  to  reported 
outcomes.  Similarly,  After  subjects  found  a higher  percentage  of  un- 
reported outcomes  to  have  been  impossible  (as  indicated  by  a probability 
of  0%)  than  did  Before  subjects  (11.5%  versus  8.0%). 

Another  way  to  appraise  the  extent  of  creeping  determinism  is  to 
translate  mean  Before  probabilities  into  the  form  of  a priori  odds 
and  the  mean  After  probabilities  for  reported  outcomes  into  a posteriori 
odds.  The  ratio  of  prior  and  posterior  odds  for  outcome  i provides  a 
sort  of  "average"  likelihood  ratio  for  the  impact  of  the  datum  "Outcome 
i did  actually  occur  " (where  the  two  hypotheses  ares  "Outcome  i occurs" 
and  "Outcome  i does  not  occur").  Over  the  24  outcomes  reported,  these 
likelihood  ratios  varied  from  1.1  to  3.7  (mean  1.96).  Thus,  in  the  present 
sense,  reporting  an  outcome's  occurrence  approximately  doubles  its  perceived 
likelihood  of  occurrence. 

Relevance  judgments.  Table  2 presents  the  mean  relevance  judgments 
for  each  datum  in  one  sub-experiment.  Inspection  reveals  that  the  relevance 
attributed  to  any  datum  is  nighly  dependent  upon  which  outcome,  if  any,  sub- 
jects believe  to  be  true.  Some  of  these  differences  seem  readily  interpretable. 
For  example,  the  fact  that  the  British  "officers  learned  caution  only  after 
sharp  reverses"  (Datum  Number  11)  was  judged  most  relevant  by  subjects 
told  of  a British  victory,  and  rather  irrelevant  by  subjects  told  of  a 
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Gurka  victory. 
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A less  impressionistic  analysis  on  the  effects  cf  outcome  knowledge 
in  relevance  judgment  preceded  in  the  following  manner.  For  each  sub- 
experiment,  a two-way  (Outcome  Reported  x Datum  Evaluated)  fixed  modVl 
ANOVA  was  performed  on  subjects*  judgments  of  data  relevance.  As  noted 
above,  for  several  sub-experiments,  the  number  c subjects  varied  over 
experimental  groups.  Rather  than  use  one  of  the  suggested  (e.g.,  Winer, 

1971)  approximate  ANOVA  solutions  for  unequal  N,  which  would  have  raised 
serious  computational  difficulties,  the  following  procedure  was  adopted: 

The  analysis  was  repeated  three  times  to  procuce  "maximum,"  "minimum," 
and  "middle"  solutions.  For  the  former,  subjects  were  randomly  sampled 
from  the  smaller  experimental  groups  and  their  responses  duplicated,  equating 
the  size  of  all  cells.  For  the  "minimum"  solution,  subjects  were  randomly 
deleted  from  the  larger  groups  until  cell  size  was  equated.  For  the  "middle" 
solution,  a combination  of  duplication  and  elimination  was  performed.  The 
same  ANOVA  was  performed  on  the  three  sets  of  data.  The  results  discussed 
hold  for  all  three  solutions. 

They  were:  (a)  In  each  nub-experiment,  there  was  a significant 

Outcome  Reported  x Datum  Evaluated  interaction,  reflecting  the  differential 
effect  of  outcome  knowledge  on  relevance  judgments  discussed  above  and 
shown  in  Table  2.  (b)  Over  the  six  sub-experiments,  only  two  weak 

Outcome  Reported  effects  emerged.  Thus,  there  is  no  indication  that 
the  whole  set  of  data  may  be  more  relevant  for  one  outcome  than  another. 

(c)  Datum  Evaluated  effects  appear  in  all  but  one  sub-experiment.  They 
reflect  data  perceived  to  be  either  relevant  or  irrelevant  whatever  happens 
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(e.g.,  Hasting's  decision  to  deal  the  Gurkas  "once  and  for  all"  [Datum  No.  A] 

was  universally  perceived  as  relevant). 

Reliance.  Subjects  in  two  of  the  sub-experiments  were  asked  to  indicate 
with  a number  from  0%  to  100%  the  extent  to  which  they  had  relied  on  the 
material  presented  in  the  passage  compared  with  general  (outside)  knowledge. 

In  both  cases,  before  subjects  indicated  relying  significantly  (p  < .05; 
median  test)  more  on  the  passage  than  did  After  subjects. 

Discussion 

Hindsight  subjects  consistently  perceived  reported  outcomes  (whether 
true  or  not  in  fact)  as  having  been  more  likely  to  occur  than  did  their 
foresightful  counterparts.  Outcome  knowledge  roughly  doubled  the  odds  favoring 
the  reported  event*3  occurrence.  Interestingly,  however,  subjects  almost 
never  assigned  100%  probability  to  the  reported  outcome.  Evidently,  they 
felt  chat  in  the  light  of  the  facts  given  in  the  description  other  outcomes 
were  still  possible  (e.g.,  "The  Gurkas  had  a 70%  chance  of  winning,  but  the 
British  still  might  have  pulled  it  off"),  consistent  with  creeping,  but 
not  philosophical f determinism. 

Relevance  judg rents,  too,  were  affected  by  which  outcome,  if  any,  was 
reported.  Such  hindsight-foresight  differences  in  perceived  data  relevance 
have  also  been  noted  by  historiographers  observing  the  creeping  determinism 
effect.  Consider,  for  example,  Tawney  (1961):  'Historians  give  an  appearance 

of  inevitability  to  an  existing  order  by  dragging  into  prominence  the  forces 
which  have  triumphed  and  thrusting  into  the  background  those  which  they 
have  swallowed  up"  (p,  177).  Or,  Wohlstetter  (1962), 

It  is  .nuch  easier  after  the  event  to  sort  the  relevant  from  the 
irrelevant  signals.  After  the  event,  of  course,  a signal  is  always 
crystal  clear.  We  can  now  see  what  disaster  it  was  signaling  since 
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the  disaster  has  occurred,  but  before  the  event  it  is  obscure  and 
pregnant  with  -.onflicting  meanings.  It  comes  to  th  observer  embedded 
in  an  atmosphere  of  'noise,'  i.e.,  in  the  company  of  all  sorts  of 
information  that  is  useless  and  irrelevant  for  predicting  the  par- 
ticular disaster."  (p.  387) 

Knowing  that  something  has  happened  clearly  increases  its  perceived 
inevitability,  as  well  as  restructures  judges'  perceptions  of  what  they 
know  about  it.  How  justified  are  these  changes?  It  is  hard  to  s*y, 
simply  because  there  are  no  objective  probabilities  associated  with  unique 
events  like  the  British-Gurka  struggle.  Consider  another  example:  If 

someone  claims  that  there  was  no  chance  (or  a 7%  change  or  a 98. 6%  chance) 
of  a thermonuclear  war  during  the  1960's,  who  can  prove  him  wrong?  Indeed, 
the  only  wrong  estimate  is  that  it  was  100%  likely. 

In  many  well-defined  situations,  the  wisdom  of  some  increase  in  the 
postdicted  probability  of  reported  outcomes  is  readily  apparent.  Consider 
the  task  of  having  to  predict  the  outcome  of  successive  draws  from  an  urn 
containing  an  unspecified  proportion  of  red  and  blue  balls.  Two  red  and 
two  blue  balls  have  been  drawn.  The  fifth  ball  drawn  is  blue.  Prior  to 
the  fifth  uraw,  the  best  estimate  of  the  probability  of  a blue  ball  being 
drawn  was  50%.  Following  the  drawing,  that  probability  is  properly 
evaluated  as  having  been  greater  than  50%.  That  is  to  say,  knowing  that 
an  outcome  has  occurs  (a  blue  ball  has  been  drawn)  increases  its  proba- 
bility of  occurrence.  Analogously,  consider  a judge  who  has  in  his  life- 
time encountered  four  British-Gurka  type  struggles,  two  of  which  were  won 
by  the  "British."  Upon  learning  of  a "Gurka'-  victory,  he  may  properly 
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update  that  outcome's  predictive  (Before)  probability  of  507  to  a higher 
postdictive  (After)  probability.  The  latter  example  also  demonstrates 
the  justifiability  of  outcome  knowledge  affecting  relevance  judgments. 

Hearing  of  a Gurka  victory  may,  for  example,  alert  a judge  to  the  true 
importance  of  British  suffering  from  climatic  extremes.  It  may  also  teach 
him  something  about  'he  nature  of  19th  century  colonialism— and  thus  change 
the  sort  of  "laws"  or  "reasons"  he  uses  in  drawing  inferences  from  the  event 
description. 

Thus,  the  judgmental  changes  which  we  have  called  "creeping  determinism" 
could  conceivably  reflect  what  judges  learn  from  outcome  reports.  The 
anecdotal  observations  presented  above  (e.g.,  Florovsky,  Schur,  Tawney), 
however,  all  suggest  that  this  is  not  the  c'.s.,  They  indicate  that  what 
pasues  for  the  wisdom  of  hindsight  often  contains  heady  doses  of  sophistry; 
that  the  perceived  inevitability  of  reported  outcomes  is  imposed  upon, 
rather  than  legitimately  inferred  from,  the  available  evidence.  Tversky 
and  Kahneman  (1971)  have  empirically  demonstrated  the  extent  to  which 
research  psvchologists  exaggerate  the  likelihood  of  results  which  they 

have  obtained. 

As  described  in  these  accounts,  the  retrospective  exaggeration  of 
likelihood  is  a largely  unconscious  process  evoked  by  receipt  of  outcome 
knowledge.  Subjects'  degree  of  awareness  of  the  effects  of  outcome  knowledge 
on  their  perceptions  is  examined  in  Experiment  2.  Aside  from  helping  to 
clarify  the  nature  of  creeping  determinism,  these  results  have  considerable 
intrinsic  interest.  Awareness  is  clearly  crucial  to  knowing  what  one  has 
learned  from  the  past  (i.e.,  from  outcome  knowledge).  It  may  be  necessary 
for  learning  from  the  past  at  all. 
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Experiment  2 

Method 

Design.  Subjects  were  presented  stimulus  materials  identical  to  those 
used  in  the  After  groups  of  Experiment  1,  with  each  event  description  accom- 
panied by  a "true"  outcome.  They  were  asked  to  r-spond  "as  they  would  have, 
had  they  not  few  the  outcome."  For  each  of  the  four  events  there  were 
four  "After  (ignore)"  groups,  one  receiving  each  possible  outcome  as  true. 

If  subjects  are  aware  of  the  effect  of  outcome  knowledge  on  their  judgments, 
the  responses  of  all  of  the  After  (ignore)  groups  should  resemble  those  of 
that  Before  group  in  Experiment  1 which  dealt  with  the  saim'  event . If 
After  (ignore)  subjects  are  completely  unable  to  ignore  the  effect  of  out- 
come knowledge,  their  responses  should  resemble  those  of  the  After  group 
in  Experiment  1 which  received  the  same  outcome  as  "true." 

Instructions.  The  cover  of  each  test  booklet  read,  "A  number  of  short 
descriptions  of  real  social  and  personal  events  appear  below,  each  with  a 
number  of  possible  outcomes.  On  the  basis  of  these  data,  we  ask  you  to 
evaluate  the  likelihood  of  the  outcomes  listed.  We  thank  you  for  your 
participation."  Each  remaining  page  of  the  test  booklet  was  identical  to 
the  corresponding  page  of  the  Experiment  1 booklet,  except  that  each  response 
section  was  preceded  with  the  instruction  to  "answer  as  you  would  have  had 
you  not  known  what  happened." 

Subjects.  Eighty  members  of  an  Introductory  Statistics  class  at  the 
University  of  Negev  participated. 

Procedure.  Questionnaires  were  randomly  distributed  to  a single  group 
of  subjects.  Each  subject  received  one  version  of  each  of  the  four  different 
In  a test  booklet,  Events  (A),  (B),  and  (C)  alternated  systematically 


events . 
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as  the  first  three  events,  with  Event  (D)  (the  least  interesting)  always 
appearing  last.  Order  was  varied  to  reduce  the  chances  that  subjects 
sitting  in  adjoining  seats  either  copied  from  one  another  or  disco\ered 

the  experimental  deception.  All  materials  were  in  Hebrew.  Questionnaires 
were  anonymous. 

Results 

Probability  estimates.  Table  3 presents  mean  probability  assignments 
by  subjects  in  each  of  the  After  (ignore)  grouos  along  with  the  responses 
of  the  corresponding  Before  group  from  Experiment  l.  The  entries  in  each 
row  will  be  called  a "profile."  They  indicate  the  probabilities  subjects 
believe  that  they  would  have  assigned  to  the  outcomes  had  they  not  known 
"v/hat  really  happened." 

Insert  Table  3 about  here 

These  reconstructed  probabilities  indicate  no  more  than  marginal  aware- 
ness of  the  effects  of  outcome  knowledge.  In  13  of  16  cases,  the  mean  After  (igno 
probability  of  the  reported  outcome  was  higher  than  the  mean  Before  proba- 
bility for  the  same  event.  For  r 'ported  outcomes  the  mean  Before-After 
(ignore)  difference  of  9.2%  was  slightly  but  not  significantly  less  than 
the  10.8%  mean  Before-After  difference  in  Experiment  1 (p  > .10;  Mann- 
Whitney  U test) . 

The  After  (ignore)  profiles  closely  resembled  the  corresponding  After 
profiles.  For  14  of  16  profiles,  the  mean  absolute  difference  between 
corresponding  cells  was  smaller  for  the  After  (ignore)-Af ter  comparison  than 
for  the  relevant  After  (ignore)-Before  comparison  (p  < .002;  sign  test). 

The  median  absolute  difference  between  corresponding  cells  was  3.7%  for 
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After  (ignore)-After , and  6. <4 "A  for  After  (ignore)-Before  (p  < .1)01;  Mann- 
Whitnev  U test). 

Relevanca  judgments.  If  After  (ignore)  subjects  are  able  to  ignore 
outcome  knowledge,  the  outcome  report  which  they  received  should  have  no 
effect  on  their  reconstructed  relevance  judgments.  Instead,  however,  these 
relevance  judgments  clearly  refected  the  outcomes  which  After  (ignore) 
subjects  believed  to  have  happened  (but  were  instructed  to  ignore).  For 
example,  in  Experiment  1,  After  subjects  told  of  a British  victory  assigned 
substantially  greater  importance  to  the  fact  chat  "British  officers  learned 
caution  only  after  sharp  reverses  (Datum  No.  11)"  than  did  Before  subjects; 
those  told  of  a Gurka  victory  assigned  it  slightly  less  importance.  After 
(ignore)  subjects  in  Experiment  2 who  were  asked  to  ignore  a report  of  British 
rictorv  believed  that  even  wicuout  the  report  they  would  have  perceived  the 
1 elevance  of  Datum  No.  11;  those  £old  to  Ignore  a report  of  Gurka  victory 
believed  t!i  t they  In  foresight  would  have  seen  its  irrelevance.  When  the 
relevance  judgment  ANOVA  of  Experiment  1 is  repeated  on  the  present  data, 
this  dependence  is  reflected  in  highly  significant  (p  < .0005)  Outcome  Reported 
x Datum  Evaluated  interactions. 

Interestingly,  for  128  of  the  184  individual  data  evaluated  by  subjeers 
in  the  four  outcome  f, roups  of  the  four  events.  After  and  After  (ignore) 
relevance  judgments  were  either  both  higher  or  botli  lowsr  than  the  corresponding 
Before  judgments  (as  was  the  case  in  the  example,  Datum  No.  11,  given  ab^ve) 

(z  = 5.23;  sign  test).  There  was  no  tendency  for  After  and  After  (ignore) 
relevance  judgments  to  be  consistently  higher  or  lower  than  Before  relevance 
judgments  which  might  in  itself  account  for  this  result. 
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Discussion 

Experiment  1 showed  that  receipt  of  outcome  knowledge  affects  subjects' 
judgments  in  the  direction  predicted  by  the  creeping  determinism  hypothesis. 
Experiment  2 has  shown  that  subjects  are  either  unaware  of  outcome  knowledge 
having  an  effect  on  their  perceptions  or,  ] f aware,  they  are  unable  to  ignore 
or  rescind  that  effect.  Both  the  relevance  and  the  probability  judgments  of 
After  (ignore)  subjects  suggest  that  they  fail  to  properly  reconstruct  fore- 
sightful (Before)  judgments  because  they  are  "anchored"  in  the  hindsightful 
state  of  mind  created  by  receipt  of  outcome  knowledge. 

It  might  be  asked  whether  this  failure  to  empathize  with  ourselves 
in  a more  ignorant  state  is  not  paralleled  by  a failure  to  empathize  with 
outcome-ignorant  others.  How  well  people  manage  to  reconstruct  the  per- 
ceptions which  others  had  before  the  occurrence  of  some  event  is  a crucial 
question  for  historians,  and  indeed  for  all  human  understanding.  The  assump- 
tion that  we  clearly  perceive  how  others  viewed  situations  before  receipt 
of  outcome  knowledge  underlies  most  second-guessing  of  their  decisions. 
Experiment  3 examined  this  question. 

Experiment  3 

Method 

Design.  Subjects  were  presented  with  stimulus  materials  identical 
to  those  used  in  Experiments  1 and  2.  They  were  asked  to  respond  as  had 
other  student  judges  who  had  not  known  the  true  outcome.  Before  (others) 
subjects  were  not  provided  with  any  outcome  knowledge.  After  (others) 
subjects  received  versions  of  the  stimulus  events  with  one  of  the  four 
possible  outcome j presented  as  the  true  outcome  (what  had  actually  happened). 
After  (others)  subjects'  task  was  essentially  to  ignore  outcome  knowledge 
in  order  to  respond  like  Before  (others)  subjects. 
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Instructions.  The  cover  of  each  test  booklet  read: 

Short  descriptions  of  a number  of  real  social  and  personal  events 
appear  below,  each  with  several  possible  outcomes.  These  descriptions 
were  presented  to  students  cf  Social  Science  in  Dth^’*  universities  In 
Israel.  (However,  they  were  not  toJu  which  of  the  possible  outcomes 
actually  happened.)  We  will  as*  you  to  guess  the  judgments  of  these 
students  regarding  the  likelihood  of  possible  outcomes.  We  thank 
you  for  your  participation. 

The  section  in  parentheses  only  appeared  in  the  instructions  for  After 
(others)  subjects.  Each  page  of  the  test  booklets  was  identical  to  t.e  cor- 
responding page  of  the  Experiment  1 test  booklets,  except  for  the  addition 
of  a reminder,  "Answer  as  you  think  other  students  (who  did  not  know  what 
happened)  answered"  before  each  response  section. 

Subjects.  Ninety-four  members  of  an  Intermediate  Statistics  class  at 
the  University  of  the  Negev  participated. 

Results 

Probability  estimates.  Table  4 presents  mean  probability  assignments 
by  subjects  in  each  group.  After  (others)  subjects'  inability  to  ignore 
the  effects  of  creeping  determinism  is  clearly  evident.  For  14  of  the  16 
reported  outcomes  (p  < .002;  sign  test),  the/  attributed  higher  probabilities 
to  outcome-ignorant  others  than  did  Before  (others)  subjects.  As  in  Experi- 
ment 2,  being  told  to  ignore  outcome  knowledge  slightly,  but  not  signif icantl/ 
(p  > .10;  Mann-Wnitney  test),  reduced  its  impact.  The  mean  Before  (others)- 
After  (others)  difference  was  8.7%  compared  with  the  mean  Before-After 
difference  of  10.8%  in  Experiment  1. 


Insert  Table  4 about  here 
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RgUvance  Judgments.  After  denote)  subjects  who  had  receive',  different 
outcome  reports  attributed  markedly  different  relevance  lodgment,,  to  the 
outcome-ignorant  others.  The  dependence  of  the  relevance  Judgments  which 
they  attributed  on  the  outcome  knowledge  which  they  were  to  Ignore  produced 
significant  (p  < .01)  Outcome  Reported  x Datum  Evaluated  Interactions  for 
each  of  the  four  events.  Thus,  After  (ignore)  subjects  expected  other  subjects 
to  have  .eon  In  foresight  pa-terns  of  data  relevance  which  they  themselves 
only  saw  in  hindsight. 

Projection.  Comparing  Tables  1 and  A,  and  3 and  A,  it  is  apparent  that 
the  entr-as  in  corresponding  Before  and  Before  (others)  cells  are  quite 
similar,  as  are  corresponding  After  (others)  and  After  (ignore)  cells 
The  mean  absolute  difference  between  entries  in  corresponding  cells  is 
3. 57.  for  the  first  comparison,  5.1%  ror  the  latter.  This  suggests  that  when 
asked  to  respond  like  similar  others,  subjects  respond  as  they  believe  they 
themselves  would  have  responded  in  similar  circ-mistances  (i.e.,  by  projection). 
Botn  the  probability  and  relevance  judgments  of  After  (other)  subjects, 
more  closely  resembled  those  of  After  (ignore)  and  After  subjects  than  those 

of  Before  (others)  subjects. 

Reasons.  Some  87%  of  the  subjects  provided  reasons  for  their  judgments. 
Although  content  analysis  of  thee 3 reasons  proved  intractable,  one  interesting 
finding  is  that  After  (others)  sul  icts  offered  consistently  more  reasons 
than  Before  subjects  (p  < .05;  mediae  test).  In  Experiment  1,  After  subjects 
reported  relying  more  on  outside  information  (as  compared  with  the  text) 
than  did  Before  subjects.  Perhaps  in  both  cases,  knowing  what  happened 
facilitates  knowing  where  to  look  for,  and  what  to  accept  as,  reasons. 


>- 
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General  Discussion 

Finding  out  that  an  outcome  has  occurred  increases  its  erceived  likeli- 
hood. Judges  are,  however,  unaware  of  the  effect  which  outcome  knowledge* 
has  on  their  perceptions.  Thus,  judges  tend  to  believe  that  this  relative 
inevitability  wap  largely  apparent  in  foresight,  without  the  benefit  of 
knowing  whr t happened. 

In  a fourth  study  (Fischhoff  & Beyth,  197.5),  subjects  were  asked  on 
the  eve  of  former  President  Nixon's  trips  to  China  and  the  I SSR  (in  early 
1972)  to  estimate  the  probability  of  various  possible  outcomes  of  the  visits 
(e.g.,  Nixon's  meeting  Chairman  liao,  visiting  Lenin's  tomb,  or  announcing  that  the 
trips  were  successful).  Two  weeks  to  six  months  after  the  trips'  completion, 
these  same  subjects  were  asked  to  remember  as  best  they  could  their  own 
original  predictions.  They  were  also  asked  to  indicate  for  each  event 
whether  or  not  they  believed  that  it  had  actually  happened. 

The  results  showed  that  subjects  remembered  having  given  higher 
probabilities  than  they  actually  had  to  events  believed  to  have  occurred 
and  lower  probabilities  to  events  which  hadn't.  Their  original  predictions 
showed  considerable  over-estimation  ot  low  probabilities,  i.e.,  too  many 
events  which  they  judged  to  be  extremely  unlikely  or  impossible  did  occur. 

The  probability  judgments  which  they  remembered,  however,  consistently 
underestimated  low  probabilities.  Indeed,  almost  no  events  to  which  they 
remembered  assigning  low  probabilities  were  perceived  to  have  occurred. 

Thus,  undiagnosed  creeping  determinism  not  only  biases  people's  im- 
pressions of  what  they  would  have  known  without  outcome  knowledge,  but  also 
their  impressions  of  what  they  themselves  and  others  actually  did  know  in 
fores ight . 


1 


Hindsight  / Foresight 
21 

Explanations . The  simplest  hypothesis  regarding  the  manner  in  which 
Judges  process  outcome  knowledge  suffices  to  account  for  these  results. 

Assume  that  upon  receipt  of  outcome  knowledge  judges  immediately  assimilate 
it  with  what  they  already  know  about  the  event  in  question.  In  other  words, 
the  retrospective  judge  attempts  to  make  "sense,"  or  a coherent  whole, 
out  of  all  that  he  knows  about  the  event.  The  changes  in  r;levance  judgments 
could  reflect  such  assimilative  meaning  adjustment. 

Assimilation  of  this  type  would  tend  to  induce  creeping  determinism 

for  judges  using  virtually  any  reasonable  technique  to  produce  subjective 
probability  estimates.  For  example,  consider  Tversky  and  Kahr.eman’s  recent 
(1974)  compendium  of  heuristics  for  producing  subjective  probabilities.  One 
such  heuristic  is  "representativeness,"  by  which  outcomes  are  deemed  iikely 
according  to  the  extent  that  they  "represent"  the  dominant  features  of 
the  situation  which  produced  them.  The  process  often  evokes  but  a simple 
associative  matching.  Assimilation  of  outcome  knowledge  should  certainly 
increase  the  perceived  "fit"  between  reported  outcomes  and  the  situations  which 
preceded  them.  A second  heuristic  leads  judges  to  evaluate  an  outcome's  likeli- 
hood by  the  relative  "availability"  of  scenarios  leading  to  its  occurrence  and 
non-occurrence.  The  judge  who  knows  "what  happened,"  and  has  adjusted  his 
perceptions  in  the  light  of  tfwt  knowledge,  may  well  find  it  difficult  to 
imagine  now  things  could  have  turned  out  otherwise. 

An  alternative  mode  of  explanation  focuses  on  ways  in  which  receipt 
of  outcome  knowledge  may  restructure  the  judgmental  task.  For  example, 
outcome  knowledge  might  tend  to  reverse  judges'  temporal  perspective  and 
encourage  the  production  of  scenarios  which  proceed  backward  in  time,  from 
the  outcome  to  the  situation  of  the  event  description.  Such  scenario 
retrodiction  may  effectively  obscure  the  ways  in  which  events  might  not  have 
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taken  place,  much  as  solving  a maze  backward  can  obscure  the  ways  in  which 
one  might  have  gotten  lost  entering  from  the  beginning. 

A second  restructuring  explanation  could  apply  to  judges  using  a third 

Tversky-Kahneman  (1974)  heuristic.  The  "anchoring  and  adjustment"  heuristic 
directs  judges  to  perform  estimation  tasks  by  initially  selecting  some 
particularly  salient  response  value  and  then  "adjusting"  up  or  down  from 
there.  Typically,  these  adjustments  are  inadequate,  and  the  judge  remains 
anchored  in  his  initial  value.  In  retrodiction,  judges  may  tend  to  adjust 
downward  from  100”.  for  reported  outcomes  and  upwaid  from  0%  for  unreported 
outcomes.  Creeping  determinism  would  result  'rom  remaining  overly  anchored 
in  these  initial  values. 

The  assimilation  or  outcome  knowledge  processing  explanations  seem  prefer- 
able to  these  restructuring  explanations  in  their  ability  to  readily  account 
for  the  underestimation  of  creeping  determinism  found  in  Experiments  2 and  3 
and  the  Fischhoff  and  Beyth  (1975)  study.  "Making  sense"  out  of  what  one  is 
told  about  the  past  seems  so  natural  and  effortless  a response,  that  one  may 
be  unaware  that  outcome  knowledge  has  had  any  effect  at  all  on  him.  Judges 
who  are  aware  that  outcome  knowledge  has  had  some  effect  on  their  perceptions 
still  face  the  unenviable  task  of  having  to  reconstruct  the  foresightful  state 
of  mind  which  preceded  receipt  of  outcome  knowledge.  The  accuracy  of  their 
reconstructed  probability  estimates  depends,  of  course,  upon  the  accuracy  of 
these  reconstructions.  The  relevance  judgments  in  Experiments  2 and  3 reflect 
their  inability  to  accomplish  that  reconstruction.  Judges  who  remain  anchored 
in  their  present,  outcome  knowledge-laden  state  of  mind  should  produce  re- 
constructed judgments  bearing  the  mark  of  creeping  determinism. 

None  of  the  present  results  indicate  that  creeping  determinism  is  affected 
by  either  the  truth  or  the  likelihood  of  the  reported  outcome,  ft  remains 
to  be  seen  if  this  is  generally  the  case.  Sherif  and  Howland  (1961)  have 
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suggested  that  highly  inconsistent  or  unintegratable  data  tend  to  be 
contrasted  or  discounted  rather  than  assimili'ed.  If  this  is  the  case, 
then  extremely  unlikely  (inconsistent)  outcome  reports  should  not  produce 
creeping  determinism  aad  subsequent  unawareness.  Other  possible  determinants 
of  the  extent  of  creeping  determinism  are  discussed  in  Fischhoff  and  Beyth 
(1975)  and  Fischhoff  (1974). 

Implications.  It  has  frequently  been  found  that  people  are  undulv  con- 
fident in  their  predictive  abilities  (e.g.,  Alpert  & Raiffa,  Note  1; 

Fischhoff  & Beyth,  1975;  Kahneman  & Tversky,  1973).  Thus,  there  are  typically 
many  outcomes  whose  occurrence  or  non-occurrence  should  constitute  relative 
"surprises"  for  them.  With  receipt  of  outcome  knowledge,  however,  their 
"surprisingness"  vanishes  or  at  least  diminishes.  In  this  light,  failure 
to  ignore  outcome  knowledge  may  be  seer,  to  hold  substantial  benefits. 

It  is  quite  flattering  to  believe,  or  lead  others  to  believe,  that  we  would 
have  "known  all  along"  what  we  could  only  know  with  outcome  knowledge,  that 
is  to  say,  that  we  possess  hindsightful  foresight.  Failure  to  adequately 
perceive  the  surprises  which  the  past  holds  and  has  held  for  us  can,  however, 
seriously  impair  our  ability  to  judge  that  past  or  learn  from  it. 

Consider  a decision-maker  who  has  been  caught  unprepared  by  some  turn 
of  events  and  who  tries  to  see  where  he  went  wrong  by  recreating  his  pre- 
outcome knowledge  state  of  mind.  If  in  retrospect  the  event  appears  to 
have  seemed  relatively  likely,  he  can  do  little  more  than  berate  himself 
for  not  taking  the  action  which  his  knowledge  seems  to  have  dictated.  He 
might  be  said  to  add  the  insult  of  regret  to  the  injury  inflicted  by  the 
event  itself.  A more  appropriate  lesson  from  the  experience  might  be  that 
the  data  at  his  disposal  are  quite  indeterminate,  and  that  he  should  be  ready 

1 
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for  a substantial  number  of  surprises  and  make  his  plans  accordingly. 

If,  however,  all  events  which  occur  appear  to  have  been  fairly  likely, 
there  is  little  reason  to  prepare  for  surprises. 

Experiment  3 suggests  that  there  are  similar  processes  ai  work  in 
second -guessing  the  decisions  of  others . Consider  looking  backward  at  an 
historical  figure  whose  plans  have  gone  awry  because  of  unanticipated 
events.  In  retrospect,  the  eventualities  which  foiled  his  plan  seem  to 
have  been  relatively  likely.  Whereas  his  failure  may  actually  reflect  his 
misfortune  in  encountering  an  unavoidable  surprise,  it  appears  to  be  a matter 
of  incompetence,  folly,  or  worse.  Yet  in  many  situations  where  information 
is  limited,  occasional  surprises— and  resulting  failures-- are  inevitable. 

It  seems  to  be  both  unfair  and  self-defeating  to  castigate  decision  makers 
who  have  erred  in  fallible  systems,  without  admitting  to  that  fallibilitv 
and  doing  something  to  improve  the  system.  A classic  case  in  point  is  the 
demotion  of  Admiral  ‘I'mmel,  Naval  C.  0.  at  Pearl  Harbor,  following  the 
Japanese  attack  in  World  Was  II.  After  reviewing  extensive  documentary 
evidence,  the  historian  Roberta  Wohlstetter  (1962)  comes  to  the  conclusion 
that  it  is  unreasonable  to  expect  any  American  military  or  political  figure 
to  have  anticipated  the  attack,  in  the  light  of  the  information  at  his  disposal 
beforehand.  She  concludes  that  the  lesson  to  be  learned  from  investigating 
the  disaster  is  to  "accept  the  fact  of  uncertainty  and  learn  to  1 xve  with 
it.  Since  no  magic  will  provide  certainty,  our  plans  must  work  without 
it"  (p.  401). 1 
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Finally,  the  judge  who  looks  at  the  past  and  finds  that  it  holds  relatively 
few  surprises  for  him  is  essentially  denying  that  he  has  /ery  much  to  learn 
from  it.  If  he  has  invested  resources  in  obtaining  outcome  knowledge  about 
some  event  and  upon  receipt  feels  that  he  really  did  know  that  it  would 
happen,  those  resources  seem  wasted.  When  judges  attempt  to  understand  past 
events,  they  implicitly  test  the  hypotheses  or  rules  they  use  to  interpret 
and  anticipate  the  world  around  them.  A past  which  is  inordinately  barren 
of  surprises  provides  an  inordinately  weak  test  of  the  hypotheses  applied 
to  it  (Popper,  1965).  The  judge  who  perceives  a relatively  surprise-free 
past  may  feel  little  compulsion  to  change  the  hypotheses  which  guided  him  in 
viewing  that  past.  Thus,  the  very  outcome  knowledge  which  gives  him  the 
feeling  that  he  understands  what  the  past  was  all  about  may  prevent  him 
from  learning  anything  from  it. 
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Daniel  Kahneman,  Paul  Slovic,  Ruth  rieyth,  and  Sarah  Lichtenstein  for  their 
contributions  to  this  project.  Reprints  are  available  from  the  author 
at  Oregon  Research  Institute,  P.  0.  Box  3196,  Eugene,  Oregon  97403. 

Elaboration  on  this  point  as  well  as  speculation  on  how  hindsight  can 
be  improved  may  Le  found  in  Fischhoff  (1974)  and  Fischhoff  and  Beyth  (1974). 
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Note:  In  each  case,  the  "none"  results  are  taken  from  the  corresponding  Before  (no  outcome)  group  m 

Exp.  1 (subjects  who  actually  responded  not  knowing  what  happened) . 


Mean  Probabilities  Assigned  by  Subjects  responding  "as  did 
other  students  who  did  not  know  what  happened"  [Exp.  3] 
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